How can we test AI performance? This question seems trivial, but it isn't. Standard benchmarks often have problems such as in-distribution and small-size test sets, oversimplified metrics, unfair comparisons, and short-term outcome pressure. As a consequence, good performance on standard benchmarks does not guarantee success in real-world scenarios. To address these problems, we present Touchstone, a large-scale collaborative segmentation benchmark of 9 types of abdominal organs.

There is little debate that AI will revolutionize working practices, but there is less agreement about the best way to exploit this transformation. While 90% of CIOs are piloting AI or investing in small or large-scale developments, over two-thirds (67%) haven't seen measurable ROI, according to the recently released Nash Squared/Harvey Nash Digital Leadership Report. "Leaders know the technology, but they're struggling with its application in the business to create value," Nash Squared CIO Ankur Anand told ZDNET during a conversation about the key points emerging from the leadership survey. So, how can business leaders overcome this struggle? Four business leaders provide their best-practice tips for using AI to solve big business problems.

Medical Imaging (MI) datasets are fundamental to artificial intelligence in healthcare. The accuracy, robustness, and fairness of diagnostic algorithms depend on the data (and its quality) used to train and evaluate the models. MI datasets used to be proprietary, but have become increasingly available to the public, including on community-contributed platforms (CCPs) like Kaggle or HuggingFace. While open data is important to enhance the redistribution of data's public value, we find that the current CCP governance model fails to uphold the quality needed and recommended practices for sharing, documenting, and evaluating datasets. In this paper, we conduct an analysis of publicly available machine learning datasets on CCPs, discussing datasets' context, and identifying limitations and gaps in the current CCP landscape. We highlight differences between MI and computer vision datasets, particularly in the potentially harmful downstream effects from poor adoption of recommended dataset management practices. We compare the analyzed datasets across several dimensions, including data sharing, data documentation, and maintenance. We find vague licenses, lack of persistent identifiers and storage, duplicates, and missing metadata, with differences between the platforms. Our research contributes to efforts in responsible data curation and AI algorithms for healthcare.

Melania Trump announced on Friday that she is releasing an AI audiobook version of her memoir, Melania. In an X post, the first lady welcomed followers into "a new era in publishing" and announced that an audiobook featuring an AI-generated version of her voice will be released in the ElevenReader app. "I am honored to bring you Melania -- The AI Audiobook -- narrated entirely using artificial intelligence in my own voice. Let the future of publishing begin." The First Lady's book, Melania, was published in October 2024, and it's part memoir, part coffee table book.

"We're excited to become a clinical-stage biotech company; it's exciting from an AI drug discovery standpoint," says Absci founder and CEO Sean McClain. Artificial intelligence has been working its way into the drug development process for years now, but with little to show so far in revamping the notoriously burdensome process. While drugs are being developed using AI in a variety of ways, no drugs developed completely by AI, from start to finish, have so far made it over the finish line of regulatory approval. For that reason, every attempt by an AI drug to get approval is a landmark of sorts. Tuesday, drug development startup Absci, based in Vancouver, Washington, announced such a landmark, the beginning of a Phase I clinical trial for a therapy it built from scratch using generative AI to treat irritable bowel disease.

AI agent deployments will grow 327% during the next two years. Chief human resources officers (CHROs) plan to expand their digital labor in the next two years, investing in AI agents to increase productivity, according to the latest Salesforce global research. By 2030, 80% of CHROs believe most companies will have humans and AI agents working together. Almost nine of every 10 CHROs will focus on integrating AI agents into the workforce. By 2027, CHROs anticipate 327% growth in agent AI adoption, from 15% in 2025 to 64% in 2027.

And, as AI gets more advanced, so do the resurrections. Most recently, Stacey Wales used AI to generate a video of her late brother, Christopher Pelkey, to address the courtroom at the sentencing hearing for the man who killed him in a road rage incident in Chandler, Arizona. According to NPR, its the first time AI has ever been used in this way. "He doesn't get a say. He doesn't get a chance to speak," Wales told NPR, referring to her brother.

Figma is a browser-based design tool and platform that helps teams collaboratively sketch everything from website layouts and app screens to interactive prototypes -- all in real time. Each year, the company hosts its Config conference to reveal major updates, and this year, at Config 2025, Figma went all-in on AI, embedding it into nearly every new product. If Config 2025 made anything clear, it's that Figma views AI as the glue connecting its entire suite of products. The ultimate goal seems to be giving designers, marketers, and all users some extra brainpower at their fingertips -- freeing them to focus more on the big picture and less on the details. For starters, Figma introduced Figma Make, an AI-powered tool that turns simple text prompts into working prototypes or even functional apps.

Cameras were first installed on the windshields of some Metro buses last year, but the first tickets were issued in mid-February. Initially, the only buses to have cameras were along line 212, from Hollywood/Vine to Hawthorne/Lennox stations via La Brea Avenue, and line 720, from Santa Monica to downtown L.A. via Wilshire Boulevard. Line 70, which services Olive Street and Grand Avenue, and lines 910 and 950 that serve Metro's J Line have since been included. The AI-powered cameras scan for illegally parked cars and compile a video of each violation, a photo of the license plate and the time and location, according to the Los Angeles County Metropolitan Transportation Authority. Each citation is reviewed by a human.

Instead, according to the researchers, AI is a general-purpose technology whose application might be better compared to the drawn-out adoption of electricity or the internet than to nuclear weapons--though they concede this is in some ways a flawed analogy. The core point, Kapoor says, is that we need to start differentiating between the rapid development of AI methods--the flashy and impressive displays of what AI can do in the lab--and what comes from the actual applications of AI, which in historical examples of other technologies lag behind by decades. "Much of the discussion of AI's societal impacts ignores this process of adoption," Kapoor told me, "and expects societal impacts to occur at the speed of technological development." In other words, the adoption of useful artificial intelligence, in his view, will be less of a tsunami and more of a trickle. In the essay, the pair make some other bracing arguments: terms like "superintelligence" are so incoherent and speculative that we shouldn't use them; AI won't automate everything but will birth a category of human labor that monitors, verifies, and supervises AI; and we should focus more on AI's likelihood to worsen current problems in society than the possibility of it creating new ones.